The bone formation process is an example of how both time and nature acted harmonically to pave the path for life as we know. The unique association between calcium phosphate (CaP) and collagen in a single building block, gave rise to one of the most remarkable biomaterials that we know. Our aim in this revision is to provide a brief glance at the different organization levels of the bone tissue, by describing the main their main features. We start with a brief discussion regarding the thermodynamic conditions for mineral formation and how living organisms surpass them. Then we present collagen, the major organic component of bone, in the light of its hierarchical organization as well as its association to CaP crystals. The mechanisms that control both mineral formation and the association with the organic phase are further presented, in which cells and other components of the extracellular matrix, such as matrix vesicles and noncollagenous proteins, become agents of bone construction. Finally, we underline the difficulty of studying the complex process of bone mineralization and present liposomes, proteoliposomes, and Langmuir monolayers as biomimetic approaches to this end.